TITLE OF THE INVENTION 
APPARATUS AND METHOD FOR DATA TRANSMISSION 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Application No. 11-373524, filed December 28, 1999, the 
entire contents of which are incorporated herein by 
reference. 

BACKGROUND OF THE INVENTION 
The present invention relates to an apparatus and 
a method for data transmission to efficiently transmit 
multimedia data comprised of a plurality of objects in 
real time through an information transmission channel 
in which data errors may occur. 

The MPEG-4 method (a method by a standardization 
group for motion picture compression of ISO/IEC), which 
is one of international standards for compression of 
motion picture coding method supports "object coding" 
to transmit a plurality of objects (visual and audio 
objects, and the like) after multiplexing. For example, 
a transmission side transmits one object of moving 
picture only for persons, and one object only for a 
background. Then, the receiving side decodes and 
synthesizes them to display them for reproduction of an 
image with a person or persons in a background image. 

FIG. 1 shows the above flow. The object coding 
will be described with reference to FIG. 1. Object 



coding sections 1 are installed for each object. 
Original data is supplied to the object coding sections 
1 and a scene description coding section 2. The object 
coding section 1 compresses and codes an object such as 
a moving picture and an audio, to output it as a data 
stream. The scene description coding section 2 codes a 
scene description. The scene description is 
information for reproduction of the objects which are 
compressed and coded at the object coding sections 1 as 
one scene. The outputs of the object coding sections 1 
and the scene description coding section 2 are 
multiplexed at a multiplexing section 3. The 
multiplexed data is transmitted to the receiving side 
through a data transmission channel 8. 

At the receiving side, the multiplexed data is 
demultiplexed to coded data of objects and scene 
description by a data demultiplexing section 4 . The 
coded object data and the scene description are 
separately processed. Object decoding sections 5 
decode the coded object data. A scene description 
decoding section 6 decodes the coded scene description. 
A scene synthesizing section 7 synthesizes the object 
data from the object decoding sections 5 for 
reproduction, based on the scene description from the 
scene description decoding section 6 . 

In a conventional device having the above 
configuration, the object coding section 1 compresses 



and codes object data such as moving picture and audio. 
Each coded object data is made into stream, which is 
called as an elementary stream. 

The scene description coding section 2 codes a 
scene description for reproduction as one scene by 
synthesizing the objects. The data multiplexing 
section 3 multiplexes data from the object coding 
sections 1 and the scene description coding section 2 
to transmit them through the data transmission channel 
8 as one stream. The data received through the data 
transmission channel 8 is supplied to the data 
demultiplexing section 4, which demultiplexes the 
multiplexed data into the coded data of objects and 
scene description. The coded data of objects are 
supplied to the object decoding sections 5, and the 
scene description to the scene decoding section 6 . 

The object decoding section 5 decodes the coded 
object data to supply the object data to the scene 
synthesizing section 1, and the scene description 
decoding section 6 decodes the coded scene description 
to supply the scene description to the scene 
synthesizing section 7. 

The scene synthesizing section 7 synthesizes 
scenes for reproduction of images, based on the object 
data from the object decoding sections 5 and the scene 
description from the scene description decoding section 
6 . The scene description denotes priority of the 
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elementary stream corresponding to each of individual 
objects. 

The priority is given to the objects according to 
production intention of an author who produces a 
5 multimedia content. For example, the priority is given 

to an object which the author looks upon as an 
important one, or to object with greater importance, as 
an object of persons generally has greater importance 
p than those of backgrounds. 

m 10 On the other hand, in wireless communication, 

^ there have been some cases where a mechanism to 

= ,i guarantee completeness of the data is introduced in the 

"'^ lower layers of a communication protocol such as a 

^ physical layer and a data-link layer by using a method 

15 through which detection of error at the receiving side 

causes request for re-transmission from the receiving 
side to the transmission side and the transmission side 
retransmits the data responding to the request when a 
transmission channel with high possibility of data 
20 errors such as wireless communication is used. 

However, the above method may not be applied to 
communications which require real-time transmission 
such as MPEG-4 of so-called stream data as one of 
important factors, since there is a serious problem 
25 such as a time lag required for the re-transmission. 

There are increased possibility to cause pauses in 
reproduction of moving picture and audio at the 
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receiving side due to time lags for the re-transmission^ 
though it is important to maintain real-time 
transmission in the transmission of the stream data. 
The pauses in the moving picture and audio become 
degradations in application qualities themselves. 

Thereby, in general real-time communication of 
multimedia data, it has been usual not to perform re- 
transmission of data at the physical layer and the 
data-link layer even with possible loss of the 
completeness of the data, except when there are 
remarkably many errors in the transmission channel. 
Therefore, there may be a case where a part of data are 
not transmitted. 

On the other hand, there has been a method to 
protect information by forward error-correction (FEC) 
where transmission is performed by adding redundant 
information to original information, considering 
possible errors in the upper layers. For example, the 
method is found in a "H.233" standard, as a typical 
protocol for multiplexing and demultiplexing in 
videophone application. In "Annex A", "Annex B", and 
"Annex C", and "Annex D" of the "H.233" standard, 
information is defined to be protected based on the FEC. 
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T.Ti^i ii iii i . ivyir^t' Hr^r-n-hT r^r> r^-F -hV|p. i' T n port:ance of each data^ 
Then^ data with greater importance^ and those wiXik<l^ss 
importance have the same error rate. But^,^-"^ the real- 
time transmission is a important^f-ec^tor , and objects 
have their own importance .^-^ifn the MPEG-4, it is useless 
to perform the errop-^dorrection coding with the same 
level of err9J?*:^correction for every object, and there 
may b^^-^^case to lose the real-time transmission. 



Iherefoi'eT — the resources are nor errecrively used, 
gi 10 BRIEF SUMMARY OF THE INVENTION 

Accordingly, it is an object of the present 
1,1 invention to provide an apparatus and a method for data 

transmission, in which it is possible to effectively 

^ . . ... 

™ use the resources, maintain the real-time transmission 

15 of data, and prevent degradation of transmitted data by 

Li 5 

O changing the level of the error-correction according to 

the importance of object, and performing the error- 
correction coding for the objects according to the 
importance . 

20 According to the present invention, there is 

provided a data transmission apparatus for transmitting 
data comprising a plurality of objects having 
respective priority, the apparatus comprising means for 
selecting an error-correction coding method for each of 

25 the plurality of objects based on the priority of each 

of the plurality of objects, means for error-correction 
coding of each of the plurality of objects using the 



selec-ted error-correction coding method, and means for 
multiplexing plurality of coded object data and 
transmitting multiplexed data through a transmission 
channel. 

According to the present invention, it may be 
possible to further comprises means for detecting a 
traffic quality of the transmission channel, and said 
selecting means may select an error-correction coding 
method based on the priority of each object and the 
traffic quality. 

According to the present invention, there is 
provided a data reception apparatus for receiving coded 
transmission data comprising a plurality of coded 
object data, each object having a priority, the 
apparatus comprising means for receiving and 
demultiplexing the coded transmission data into the 
plurality of coded object data, means for detecting the 
priority of each object, and means for error-correction 
decoding of each of the coded object data based on the 
priority detected by said detecting means. 

According to the present invention, there is 
provided an object coding apparatus for transmitting 
data formed of a plurality of object data and 
scene description data, each object having a priority, 
the scene description data indicating the priority 
of each object and how the object data are synthesized, 
the apparatus comprising means for determining 



error-correction coding methods for the plurality of 
object data respectively based on the priority^ means 
for error-correction coding of each of the plurality of 
object data using the determined error-correction 
coding methods, means for error-correction coding of 
the scene description data using a predetermined error- 
correction coding method, and means for multiplexing 
coded scene description data and a plurality of coded 
object data and transmitting multiplexed data. 

According to the present invention, there is 
provided an object coding/decoding system comprising 
means for determining error-correction coding methods 
for the plurality of object data respectively based on 
the priority, means for error-correction coding of each 
of the plurality of object data using the determined 
error-correction coding methods, means for error- 
correction coding of the scene description data using a 
predetermined error-correction coding method, means for 
multiplexing coded scene description data and a 
plurality of coded object data and transmitting 
multiplexed data, means for receiving and 
demultiplexing the multiplexed data from said object 
coding apparatus into the coded scene description data 
and the plurality of coded object data, means for 
detecting the priority of each object from the coded 
scene description data, means for error-correction 
decoding of each of the plurality of coded object data 
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using a decoding method based on the priority detected 
by said detecting means, means for error-correction 
decoding of the coded scene description data using a 
predetermined decoding method, and means for 
5 synthesizing plurality of decoded object data based on 

a decoded scene description. 

According to the present invention, it is possible 
to effectively use the resources, maintain the real- 
Q time transmission of data, and prevent degradation of 

yl 10 transmitted data by changing the level of the error- 

01 

^ correction according to the importance of object, and 

hj performing the error-correction coding for the objects 

according to the importance . 

Additional objects and advantages of the present 

it 15 invention will be set forth in the description which 

y 1 

y follows, and in part will be obvious from the 

description, or may be learned by practice of the 
present invention . 

The objects and advantages of the present 
20 invention may be realized and obtained by means of the 

instrumentalities and combinations particularly pointed 
out hereinafter. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
The accompanying drawings, which are incorporated 
25 in and constitute a part of the specification, 

illustrate presently preferred embodiments of the 
present invention and, together with the general 
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description given above and the detailed description of 
the preferred embodiments given below ^ serve to explain 
the principles of the present invention in which: 

FIG. 1 shows a block diagram of a conventional 
5 data transmission apparatus; 

FIG. 2 shows a block diagram of a configuration 
example of a first embodiment of a data transmission 
apparatus according to the present invention; 

0 FIG. 3 shows a view for explaining an FEC method 

^£ 

01 10 according to plural-time transmission method as one 

y j 

g embodiment of the error-correction coding methods ; 

Ijl FIG. 4 shows a view of a packet configuration for 

a packet multiplexing section of the first embodiment; 
% and 

15 FIG. 5 shows a block diagram of a configuration 

example of a principal part of a second embodiment of a 
data transmission apparatus of the present invention. 
DETAILED DESCRIPTION OF THE INVENTION 
A preferred embodiment of a data transmission 
20 apparatus according to the present invention will now 

be described with reference to the accompanying 
drawings . 

Firstly, a basic principle of the present 
invention will be described. In the present invention, 
25 data with relatively greater importance is protected in 

data transmission on a transmission channel with 
possible errors by performing error-correction 
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according to a priority of the data, referring to a 
stream priority included in the MPEG-4 objects not only 
in the MPEG-4 system, but also in a data multiplexing 
and transmission section. 

The present invention relates to a transmission 
system which multiplexes a plurality of objects (visual 
objects, audio object and the like), and transmits 
multiplexed data through a transmission channel. In 
the system, the priority denoting the priority on 
importance is previously given to each object and real- 
time transmission is required, for example, data 
transmission according to the MPEG-4, The priority, 
which the MPEG-4 has, for each object, is utilized such 
that an error-correction coding method is selected 
according to the priority of each object, and error- 
correction coding is performed according to the 
selected error-correction coding method. Therefore, an 
increase of data amount is prevented while protecting 
data with relatively greater importance. Thereby, it 
is possible to maintain real-time transmission of 
objects so that there is no pause in moving picture 
data and audio data at the receiving side and to 
prevent the degradation of data at reproduction. 

The priority given to each object in the MPEG-4 is 
used within reproduction process of MPEG-4, and assumed 
to be applied to the cases shown as follows: 

(i) reproduction of objects with less priority is 



temporarily stopped^ or reproduction quality of objects 
with less priority is degraded, when there is an 
insufficiency in reproduction ability of the MPEG-4 
decoder at the receiving side; 

(ii) transmission of objects with less priority is 
temporarily stopped in the MPEG-4 system at the 
transmission side, when there is an insufficiency in 
reproduction ability of the MPEG-4 decoder at the 
receiving side. 

■eTTfer, in an actual transmitting and r^deij^iii^ 
system to transmit data of MPEG-4, the dat^.^-^"""^^ 
multiplexing section, and the data tj?^nsmiss ion section 
in the transmitting system (in^^ifiany cases, the two 
sections are realized as jerfie operational block. They 
are called as "data nriiltiplexing/transmission section 
(Trans Mux)") i^^ssumed to basically use standard 
methods (MPB<^-2 TS, H.223, RTP, and the like.)* 
Transmission control considering the priority of 
obje^s like the present invention is actually beyond 

t no limits of the standard. - 

Therefore, the above priority has not been 
considered to be used at the data multiplexing section 
and data transmission section at all. In the present 
invention, the above priority is used at the data 
multiplexing section and transmission section to 
control increase of the data amount by selecting an 
error-correction coding method according to the 
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priority of each object, and by performing the error- 
correction coding according to the selected error- 
correction coding method • Thereby, it is possible to 
eliminate pauses in reproduction in moving picture and 
5 audio at the receiving side, and control the 

degradation of data in reproduction of contents, while 
the real-time transmission of objects is maintained. 
First Embodiment 

Q FIG. 2 shows an example (block diagram) of overall 

01 10 system of the first embodiment. The parts similar to 

m 

g those previously shown in FIG. 1 are denoted by the 

hj Scime reference numbers, and detailed description will 

^' be eliminated. 

^ A data multiplexing section 30 multiplexes coded 

:z 15 data from the object coding sections 1 and the scene 

if description coding section 2, and the multiplexed data 

is transmitted to the receiving side through the data 
transmission channel 8. The data multiplexing section 
30 comprises an error-correction coding section 31, a 
20 packet multiplexing section 32, and a data transmission 

section 33. The error-correction coding section 31 
selects an error-correction method, based on priority 
information of the coded data, and has a function to 
perform error-correction coding the code data, using 
25 the selected error-correction method. 

error e t ji l^ scLion coding ooction 31 rGcoive s — 
tare coded— sceLtxa, description_j:j& f lecting thp intent ion of 
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an^^a uLhoj- Wl iu pji' odu c uu uo iiLui its and it iakes a 
relationship table between each of the elemept^ry 
streams and its priority as shown in TaJ)ie 1 . The 
error-correction coding section 31*x^ased on the 
priority information of the s-tp^m; selects an error- 
correction method; and performs error-correction coding 
of each stream with th^er selected error-correction 
method. The error>^orrection coding section 31 also 
has a functiqp^o perform error-correction coding of 
the scenQ/^escription, similarly to each stream. The 
scene-^descrlption is regarded as the most important 

Table 1 



Stream 


Priority 


ES_ID1 


16 


ES_ID2 


8 


ES_ID3 


4 



15 The packet multiplexing section 32 receives each 

coded stream and scene description after error- 
correction coding by the error-correction coding 
section 31, multiplexes them, and makes them into 
packet data for transmission on the data transmission 

20 channel 8. The data transmission section 33 adds 

necessary header based on individual transmission 
protocol to the packet with the above configuration, 
and outputs the packet data to the data transmission 
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channel 8 . 

A data demultiplexing section 4 0 demultiplexes the 
multiplexed data received through the data transmission 
channel 8 into the coded elementary stream and coded 
5 scene description. The data demultiplexing section 4 0 

comprises a data reception section 43, a packet 
demultiplexing section 42, and an error-correction 
decoding section 41. The data reception section 43 

0 receives the packet data transmitted on the data 

01 10 transmission channel 8, and the packet demultiplexing 

section 42 demultiplexes the packet data received by 
the data reception section 43 into the coded elementary 
stream and coded scene description based on the 
multiplexing header part. 

15 The error-correction decoding section 41 obtains 

the priority of each coded elementary stream from coded 
scene description, and performs error-correction 
decoding based on the error-correction method according 
to the priority. When the error-correction method used 
20 for the error-correction coding is, for example, a 

plural-time transmission method, a repeated time for 
each code is determined according to the priority. The 
section 41 has a function for reproducing the 
elementary streams and coded scene description by 
25 removing bits from each streeim and the coded scene 

description by the repeated times . 

The object decoding sections 5 decode the 



elementary streams to reproduce the object data. The 
scene description decoding section 6 decodes the coded 
scene description. The scene synthesizing section 7 
synthesizes the object data from the object decoding 
sections 5 for reproduction,, based on the scene 
description from the scene description decoding 
section 6 . 

In the device having such configuration^ each 
object such as moving pictures and audio is compressed 
and coded by the object coding section 1. Each coded 
object data is made into one stream which is called as 
an elementary stream (ES). 

The scene description, which is information for 
reproduction of one scene by synthesizing the objects, 
is coded by the scene description coding section 2 . 

The data multiplexing section 30 performs error- 
correction coding of the elementary streams ES and 
scene description, multiplexes them, and sends the 
multiplexed data to the data transmission channel 8. 

The feature of the present embodiment is to 
protect data with relatively greater importance at data 
transmission on a transmission channel with possible 
errors by performing error-correction according to the 
priority, referring to stream priority information 
included in the MPEG-4 objects as information on the 
priority of objects not only in the MPEG-4 system, but 
also in the data multiplexing section 30. 
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^^JJie— MPEG-4 , — trtr e - priority information o foac^h ' 
stream is included in the scene description,..,^t5r^^u^ in 
reproduction of images. Then, in thi&^^mbodiment , an 
appropriate error-correction mepiiod of each object has 
been selected according tpx-'^^he priority information. 
In order to realize ^^ect the method, the error- 
correction cod^Tfg section 31 analyzes the priority 
information based on the scene description, and selects 
an ^j ^ x^P^"^ '^'^^ o-r-rr>Y- nrM-rert r l OP mp ^ thnd of onrh nbjr > p t 

However, the information on the scene description 
is made into data in binary form in the case of MPEG-4, 
and then, there are some difficulties for the data 
multiplexing section 30 to analyze the priority. For 
such cases, it is possible to provide another interface 
different from the scene description coding section 2, 
and the priority information may be input through the 
above interface to the data multiplexing section 30. 

The error-correction coding section 31 makes a 
relationship table (Table 1) between each stream and 
its priority, using information on the scene 
description. 

In the case of an example shown in Table 1, the 
stream of "es_ID1" has priority "l6" , one of 
"es_ID2" priority "8" , one of "eS_ID3" priority 
"4" , and the like. 

Then, the error-correction coding section 31 
selects an error-correction method based on the 
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priority of the stream. In general, the error- 
correction methods by FEC (forward error-correction) 
are roughly classified into two methods shown in the 
following. 

5 [ 1 ] A method in which the same data are repeatedly 

transmitted a plurality of times (plural-time 
transmission method). 

[ 2 ] A method in which codes are used so as to 
correct errors (error-correction coding). 

10 Hereinafter, an example adopting the former type, 

the plural-time transmission method will be described. 

In plural-time transmission method, one bit-field 
is simply repeated a plurality of times according to 
the level of error-correction. The receiving side 

15 estimates the bit, for example, by a majority method. 

For example, in the case of an error-correction coding 
where the number of repetition is three, if contents of 
the data of a certain one bit-field includes one "0", 
and two "l"s, the bit is judged to be "1". It may be 

20 possible to theoretically perform 100% error-correction 

for random errors with 33 [%] by the three-time 
transmission method at the receiving side. Hereinafter, 
the plural-time transmission method is assumed to be 
adopted in the present embodiment, for simplicity. 

25 As a method to determine an appropriate level (the 

number of repetition) of the error-correction method 
used for the plural-time transmission method, it is 



assumed to be selected by a value obtained by 
multiplication of a certain constant k by the priority 
of objects. That is^ the number of repetition for the 
priority of objects is selected by the following 
equation: 

Number of repetition = priority of streams X k 

... (1) 

where, a word of the priority of streams is used, 
in stead of a word of the priority of objects, in the 
equation (1), but they actually denote the same, though 
the word of the priority streams is used, considering 
that the priority is given to a data stream as the 
error-correction coding is performed for data streeims 
to be transmitted, and the target is a data stream. 

Now, if Table 1 shows the relationship between 
streams and priorities, numbers of repetition selected 
based on the equation (1) are shown in Table 2. Where 
k = 0.3. 



Table 2 



stream 


Priority 


Repetition 
number 


ES_ID1 


16 


4 


ES_ID2 


8 


2 


ES_ID3 


4 


1 



The case of an example shown in Table 2 shows that 
a stream of "es_ID1'' has a priority of 16, and the 



number of repetition is 4; a stream of "es_ID2" has a 
priority of 8 , and the number of repetition is 2 ; and a 
stream of "es_ID3" has a priority of 4, and the number 
of repetition is 1; and the like. 

Thus^ the error-correction coding section 31 
performs error-correction coding of data of each stream 
selected by the error-correction method based on the 
priority. 

Fig. 3 shows a configuration example of packets 
where the plural-time transmission method is used for 
error-correction, and the number of repetition is 3. 
That is, when original data is formed of bO, bl, 
b2 , . . • f and the number of repetition is 3 in the 
plural-time transmission method, the packet 
configuration is: bO , bO, bO, bl, bl, bl, b2 , b2 , 
b2, where the same bit is repeated by three. 

The error-correction coding section 31 also 
performs error-correction coding of the scene 
description similarly to the streams. As the scene 
description is the most important data, error- 
correction coding is performed for the data with the 
greatest importance. For example, it is assumed that 
the scene description has the priority twice the 
highest one in the priority among streams. Therefore, 
the number of repetition becomes six times in the 
example of FIG. 3. 

The data after error-correction coding by the 
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error-correction coding section 31 are delivered to the 
packet multiplexing section 32. The packet 
multiplexing section 32 multiplexes the data of each 
stream and the scene description after error-correction^ 
5 and makes them into one packet for transmission on the 

data transmission channel 8. 

Fig. 4 shows a packet configuration example in the 
packet multiplexing section 32 . The configuration of 
the packet is as shown in FIG. 4: multiplexing header, 

10 scene description, ES_1 header, ES_1 pay load, ES_2 

header, ES_2 pay load, and where ES_1, ES_2, ... 

denote No. 1, No. 2, ... of the elementary stream ES. 

The transmission section 33 adds a necessary 
header based on a transmission protocol to the packet 

15 comprised in the above manner; and outputs the packet 

to the data transmission channel 8. 

Now, processing in the receiving system will be 
described. In the receiving system, the data 
transmitted through the data transmission channel 8 is 

2 0 received by the data demultiplexing section 40. 

Specifically, the data reception section 43 receives 
the packet data from the transmission side transmitted 
as packet in a form shown in FIG. 4, and supplies it to 
the packet demultiplexing section 42. 

25 The packet demultiplexing section 42 demultiplexes 

the received packet into the streams and scene 
description, referring to the multiplexing header, and 
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supplies them to the error-correction decoding section 
41. 

The error-correction decoding section 41 obtains 
the priority of each stream from the scene description, 
5 and selects the number of repetition, based on the 

above equation ( 1 ) . The scene description is made into 
a binary form in the case of the MPEG-4, and it is 
difficult to analyze it at the data demultiplexing 
section 40. Therefore, once the scene description 
10 information is supplied to the scene description 

decoding section 6, the analyzed object priority 
information is supplied to the data demultiplexing 
section 4 0 through another interface. 

The error-correction decoding section 41 performs 
;^ 15 error-correction decoding of the code, based on the 

^ information on the number of repetition obtained 

through the above selection. An error-correction 
decoding method used for the above case is the above 
selection method by majority. 
20 As shown above, as there is less degradation in 

data quality due to data errors for objects with higher 
importance by transmitting data after performing error- 
correction coding with changing the error-correction 
ability, according to the priority of each object given 
25 beforehand when performing error-correction coding for 

transmission of each object of MPEG-4, data 
transmission with high quality may be realized in the 



present embodiment* As the error-correction coding is 
performed/ changing the level of the error-correction 
according to the priority of each object, the amount of 
data is increased for the important one, and it is 
decreased for less important one. Therefore, data 
transmission with high quality may be realized without 
excessively increased amount of data, and with real- 
time transmission. 

In the above embodiment, the error-correction 
coding method is adapt ively changed in each object, 
based on the importance of objects composing a content, 
and it is possible to obtain data reproduction quality 
similar to the intention of a content author at the 
data receiving side in data transmission through a data 
transmission channel with unavoidable data errors, 
though the quality of the transmission channel is not 
considered. 

But, an ideal fine control may become possible by 
consideration of the quality of the channel. For 
example / the level for error-correction may be lowered 
on a transmission channel with less possibility of 
error generation, and it may be required to further 
raise the error-correction level for keeping the data 
reproduction quality on the channel with increased 
possibility of the generation. 

Then, a second embodiment with consideration of 
the quality of the transmission channel will be 
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described hereinafter. 
Second embodiment 

In the present embodiment, a detector for 
detecting traffic on the data transmission channel 8 is 
newly installed, and there is shown an excimple where 
the error-correction coding method is selected based on 
the output of the detector as well as the priority. In 
this embodiment, traffic situation on the data 
transmission channel 8 is detected, using the detector 
to detect traffic on the data transmission channel 8, 
in addition to the configuration of the first 
embodiment. Thereby, the data receiving side may 
obtain further higher data reproduction quality, and it 
is possible to prevent the degradation in reproduction 
of objects from received data with data errors caused 
on the transmission channel 8, without causing 
excessively increased amount of data, and while 
maintaining real-time transmission, in data 
transmission of objects. 

FIG. 5 shows an example of a principal portion of 
a system in the present embodiment. A basic 
configuration is the same as that of the first 
embodiment shown in FIG. 2, comprising the object 
coding sections 1 (not shown) coding the object data; 
scene description coding section 2 (not shown) for 
coding the scene description; data multiplexing section 
30 multiplexing data from the object coding sections 1 



and the scene description coding section 2 , and 
transmitting the multiplexed data to the data 
transmission channel 8; data demultiplexing section 40 
(not shown) demultiplexing the multiplexed data 
transmitted through the data transmission channel 8; 
object decoding sections 5 (not shown) decoding the 
streams; scene description decoding section 6 (not 
shown) decoding the coded scene description? and scene 
synthesizing section 7 (not shown) synthesizing scenes, 
based on the object data from the object decoding 
sections 5, and the scene description from the scene 
description decoding section 6 to reproduce images. 

The data multiplexing section 30 according to the 
second embodiment also comprises the error-correction 
coding section 31, packet multiplexing section 32, and 
data transmission section 33. Moreover, a transmission 
traffic detector 50 to detect a traffic state on the 
data transmission channel 8 is newly installed, other 
than the above sections, in the present embodiment. 

The transmission traffic detector 50 detects the 
quality (data error incidence, data transmission rate, 
and the like) of the data transmission channel 8 during 
communication. The error-correction coding section 31 
receives the scene description reflecting the intention 
of a content author; makes a relationship table between 
each stream and the priority, for example, as shown in 
Table 1; then, selects an error-correction coding 



method, based on the priority of the stream; and 
performs error-correction coding of each stream with 
the selected error-correction coding method. The 
error-correction coding section 31 has a function to 
perform error-correction coding of data of the scene 
description, similarly to the case of each stream. As 
the scene description is the most important data, the 
description is configured to be coded for error- 
correction as data with the greatest importance. 

Moreover, the error-correction coding section 31 
has a function to perform error-correction coding of 
each stream according to the quality of the data 
transmission channel 8 detected by the transmission 
traffic detector 50. The error-correction coding 
section 31 is configured so that the error-correction 
coding method selected based on the priority given to 
each stream may be added, and the error-correction 
ability may be changed according to the quality of the 
transmission channel 8 in the error-correction coding 
method of the first embodiment, by applying an error- 
correction coding method selected according to the 
quality of the data transmission channel 8. 

The packet multiplexing section 32 receives data 
of each stream and scene description after error- 
correction by the error-correction coding section 31, 
multiplexes them into packet data (one stream for data 
transmission). The data transmission section 33 adds a 



necessary header based on a transmission protocol to 
the packet configured as above, and outputs the packet 
data to the data transmission channel 8. 

In the present embodiment, the basic configuration 
is similar to that of the first embodiment, except 
processing in the error-correction coding section 31 
and the transmission traffic detector 50. 

The feature of the present embodiment is in 
processing in the error-correction coding section 31 
and the transmission traffic detector 50. The 
processing in the two blocks will be mainly described 
hereinafter. 

The transmission traffic detector 50 detects the 
quality of the traffic on the data transmission channel 
8 during communication. The quality denotes: 
data error incidence; 

data transmission rate; and the like. 
In the present embodiment, the data error incidence is 
detected. The information on the quality of the 
traffic detected in the transmission traffic detector 
5 0 is appropriately transmitted to the error-correction 
coding section 31. 

The error-correction coding section 31 performs 
error-correction coding of each stream based on the 
data error incidence information detected by the 
transmission traffic detector 50 and the stream 
priority which is described in the scene description. 
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l-^-jrg— assume r i ""fTiat: the piurai-time transmission^ 
method is used as a method of the error^rjser^ection 
coding. The number of repetij^j^olito determine the 
error concealment is defined by the following 
expression. If is assumed that, for example, £ 1 is 
as a mean ejr^r incidence, £ 2 as the present error 
incideijjce, and a certain constant k, the number of 
reja^tJL tion may bo selected by Lhe foTTowing equation; 
Number of repetition: 

1 + (stream priority) X (f2/£l) X k (2) 

Thus, in addition to the first embodiment, it is 
possible to perform more efficient data transmission 
suitable for the state of the data transmission channel 
8 by changing the error-correction level according to 
the quality of the data transmission channel 8. 

As mentioned above, the present embodiment is a 
transmission system to multiplex and transmit a 
plurality of objects through the transmission channel 8. 
In the data transmission apparatus in which priority of 
each object is previously given, and real-time 
transmission is required, the communication traffic 
detector 50 which detects the quality of the traffic of 
the transmission channel 8 is installed; and the ^error- 
correction coding section 31 is installed. The data 
multiplexing section 30 has a function to determine an 
error-correction coding method for each object, based 
on the quality information on the traffic obtained by 



the communication traffic detector 50, and the priority 
given to each object. 

The communication traffic detector 50 detects the 
quality of the traffic of the transmission channel 8, 
for example, data error incidence ^ data transmission 
rate, and the like. In the error-correction coding 
section 31, the error-correction coding method with 
required error-correction ability is selected, based on 
the quality information on the traffic, and the 
priority given to each object. Error-correction coding 
of each object is performed with the selected error- 
correction coding method. Data after the error- 
correction coding are multiplexed by the multiplexing 
section 32, and delivered to the transmission channel 8 
through the data transmission section 33. There have 
been known several error-correction coding methods . 
For example, if plural-time transmission method is used, 
as a determining factor for the error-correction 
ability is the number of repetition, the above number 
of repetition is defined as follows. 

For example, the number is 1 + (stream priority) X 
( £ 2/ f 1) X k, if it is assumed that the mean error 
incidence is set as f 1 , the present error incidence as 
E 2 and a certain constant as k. 

Thus,, more efficient data transmission suitable 
for the situation of the transmission channel 8, and 
data transmission to prevent degradation in reproduced 
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content^ while maintaining real-time transmission is 
realized by performing error-correction coding by 
changing the error-correction level according to the 
quality of the transmission channel in addition to the 
priority of the stream. 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, 
the present invention in its broader aspects is not 
limited to the specific details, representative devices, 
and illustrated examples shown and described herein. 
Accordingly, various modifications may be made without 
departing from the spirit or scope of the general 
inventive concept as defined by the appended claims and 
their equivalents. For example, in the above 
embodiments, the error-correction level is changed 
according to the object priority (the importance of the 
object), but it is possible that transmission of 
objects with lower priority, for example, a background 
part, is stopped at the data multiplexing and 
transmission section without changing the error- 
correction coding method. For example, it is possible 
to stop one of error-correction coding, multiplexing, 
and transmission at the transmission side and to stop 
error-correction decoding at the reception side based 
on the priority. Further, it may be conceivable that 
transmission of objects with lower priority than a 
certain level is stopped, when the communication 
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quality of the transmission channel is temporarily 
degraded by feedback from the traffic detector^ and the 
data transmission rate is lowered. 

The present invention may realize an apparatus 
5 with further more efficient data transmission by 

installing a monitor of the traffic state on the data 
transmission channel and considering the traffic 
information from the monitor. For example / if there 
are a plurality of transmission channels, it is 

10 possible to assign a transmission channel with less 

error incidence for objects with greater importance, or 
stop data transmission in a unit of an object, in 
addition to changing the error-correction coding method. 
Thereby, it is possible to realize a system to transmit 

15 important object data in real-time, depending on the 

situations . 

As mentioned above in detail, according to the 
present invention, in data transmission through a 
data transmission channel with unavoidable data error 

20 incidence, the data receiving side may obtain data 

reproduction quality approximately according to the 
intention of a content author by adaptively changing 
the error-correction coding method every object based 
on the importance of object, or the data receiving side 

25 may obtain further better data reproduction quality 

by detecting the traffic state on the data 
transmission channel, and by adaptively changing 
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the error-correction coding method according to the 
detection result. It is possible to provide a data 
transmission apparatus to prevent the degradation in 
object reproduction from received data with data errors 
caused during transmission on the transmission channel 
while maintaining the real-time transmission without 
excessive increased amount of data in data transmission 
of objects. 



